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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH{S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )K Responsive to connmunication(s) filed on 21 October 2002 . 
2a)l3 This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 1-68 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-68 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on Is/are: a)n accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) ^ The proposed drawing correction filed on 01 November 1999 is: a)^ approved b)^ disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

1 3) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)nAII b)n Some*c)n None of: 

1 .□ Certified copies of the priority documents have been received. 

2.0 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 1 7.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 11 9(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
Attachment(s) 

1 ) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) n Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) CH Notice of Infomial Patent Application (PTO-152) 

3) □ Infomnation Disclosure Statement(s) (PTO-1449) Paper No(s) , 6) □ Other: 
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DETAILED ACTION 



Claim Rejections - 35 USC § 102 



1. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
(e) the invention was described in- 

(1) an application for patent, published under section 122(b), by another filed in the United States before the 
invention by the applicant for patent, except that an international application filed under the treaty defined in 
section 351(a) shall have the effect under this subsection of a national application published under section 122(b) 
only if the international application designating the United States was published under Article 21(2)(a) of such 
treaty in the English language; or 

(2) a patent granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that a patent shall not be deemed filed in the United States for the purposes of this 
subsection based on the filing of an international application filed under the treaty defined in section 351(a). 

2. Claimsl-23, 25-33, 35-61 & 63-68 are rejected under 35 U.S.C. 102(e) as being 
unpatentable by Ullman et al (U.S. 6,330,595). 

As per claim 1-4,36 Ullman disclosed a procedure for using a time-dependent hyperlink in video, 
comprising the steps of: (a) associating content reference for at least one hyperlink with a video 
by associating the content reference v^ith coordinates at which the hyperlink appears in the video, 
wherein one of the coordinates includes time (col. 3, lines 29-43); (b) transmitting the video from 
a first content server to a video browser of a user display (col. 4, lines 44-54); (c) selecting by the 
user a selected hyperlink in the video by selecting coordinates at which the selected hyperlink 
appears in the video (col. 3, lines 63-67 & col. 4, lines 1-2); (d) determining the content 
reference for a new session of the selected hyperlink based on the selected coordinates (col. 9, 
lines 60-65); (e) initiating a connection of the browser to the new session of the selected 
hyperUnk(col. 7, lines 40-50); and (f) switching the connection of the browser from the first 
content server to the new session (col. 8, lines 59-67). 

3. As per claim 5 Ullman disclosed wherein said step (d) comprises looking up the content 
reference in a database in the current content server based on the coordinates selected in said step 
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(c) (col. 7, lines 1 1-29), the database including the content reference cross-referenced with the 
coordinates at which the at least one hyperhnk for the content reference appears in the video (col. 
7, hnes 40-51). 



4. As per claim 6 Ullman disclosed further comprising the step of downloading a file from 
the current content server to the browser before performing said step (b) (col. 9, lines 45-53), the 
file containing a database including the content reference cross-referenced with the coordinates 
at which the at least one hyperlink for the content reference appears in the video and said step (d) 
comprises looking up the content reference in the downloaded file based on the coordinates 
selected in said step (c) (col. 6, lines 37-52). 

5. As per claim 7,8,37,51,52 Ullman disclosed wherein said step (e) further comprises 
initiating at a call processing server a connection to the new session of the selected hyperlink 
(col. 5, lines 4-12), the call processing server being arranged between the current content server 
and the browser (col. 5, lines 48-52). 

6. As per claim 9,10-13,26-28,39-41,54-56 Ullman disclosed further comprising the step of 
downloading the switchover application containing information on the at least one hyperlink in 
the video being transmitted in said step (b) (col. 8, lines 39-67). 

7. As per claim 14,20,29,43,58,64 Ulbnan disclosed wherein the switchover application 
performs at least one of the following steps: downloading given contents at given points in time; 
playing contents at given points in time (col. 3, lines 50-56); checking content server availability; 
selecting fi-om several content servers depending on server load status; requesting the current 
content server to prepare a content for transmission; requesting the current content server to start 
transmitting a prepared document; requesting the current content server to start transmitting 
content fi-om a given displacement (col. 12, lines 1-22 & col. 13, lines 8-26); requesting a 
downloading of a new switchover application for the content referred to by a link (col. 8, lines 
44-54); establishing a new session to new content at given points in time; submitting received 
call processing language scripts to assist establishment of a new session (col. 5, lines 4-12); 
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determining round trip delay between the browser and the content server of the selected 
hyperlink and adjusting switchover times on the determination (coL 6, Unes 24-34 & lines 55- 
59); determining permanent terminal or terminal location specific implications to general session 
establishment time and adjusting switchover schedules based on the determination; A performing 
procedures needed to join a multicast session; reserving network resources for a. new session 
under establishment or a link or data stream being resumed; freeing network resources for a new 
session being cleared or a link or data stream being paused; performing video/audio content 
switchover at a given point in time (col. 8, lines 44-67); comparing link descriptive information 
with user preference attributes and browser capabilities, in case of failure to satisfy the 
preference attributes; and cancelling the visualization of the link to the user in case of failure 
(col. 3, lines 50-67). 

8. As per claim 15,21,30,33,44,59,65 Ulhnan disclosed wherein said step (f) comprises 
maintaining a session to the first content server and the switchover application performs the 
following steps: establishing a new session toward the content of the selected hyperlink at a 
given point in time; pausing the video/audio content stream of the original content at said step 
(f); resuming the video/audio content stream of the original content at switchover back to the 
original content; and releasing the new session toward the content of the selected hyperlink after 
switchover back to the original content (col 8, lines 44-67). 

9. As per claim 16,22,3 1 ,45,60,66 UUman disclosed wherein said step of resuming the 
video/audio content stream of the original content including resuming at the point in the original 
content at which the original content was paused (col. 9, lines 25-31). 

10. As per claim 17,23,32,46,61,67 Ullman disclosed wherein the switchover application 
caches a history of switchover applications. 

11. As per claim 18,42,57 Ulhnan disclosed wherein said steps (d), (e), and (f) are performed 
using a switchover application associated with the video in the first content server, said step of 
transmitting a link stream comprises transmitting a link stream including link selection and 
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switchover preparation schedules, said switchover preparation schedules specified ascii tag 
notation such that said switchover application performs the step of interpreting said ascii tag 
notation (col. 6, lines 34-51). 

12. As per claim 19,63 Ullman disclosed wherein said step (d) includes using an algorithm 
that determines the location of a hyperlink based on visual characteristics in the video (col. 7, 
lines 40-51). 

13. As per claim 25 Ullman disclosed further comprising the step of downloading a 
switchover application to said call processing server or a service control means connected to said 
call processing server, said switchover application containing information on links in the video 
being transmitted in said step (b) (col. 7, lines 40-51). 

14. As per claim 35 Ullman disclosed further comprising means for transmitting a link 
stream containing said content reference of said at least one hyperlink from said first content 
server to said browser on a first communication channel and transmitting said video fi-om said 
first content server to said browser in parallel to said link stream on a second communication 
channel (col. 8, lines 19-37). 

15. As per claim 38,53 Ullman disclosed wherein said content server comprises a switchover 
application for performing a smooth switchover and said means for performing a smooth 
switchover comprises a means for using said switchover application (col. 6, lines 37-48). 

16. As per claim 47 Ullman disclosed wherein said content server further comprises a link 
database (col. 6, lines 55-62) 

17. As per claim 48 Ullman disclosed further comprising means for downloading said link 
database to said browser (col. 6, lines 44-51). 
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18. As per claim 49 Ullman disclosed wherein said means for determining when said 
hyperUnk is selected comprises means for querying said link database (col. 10, lines 46-54). 

19. As per claim 50 Ullman disclosed further comprising a call processing server arranged 
between said browser and said first content server, said call processing server comprising said 
means for switching over a connection of said user input/output device fi"om said first content 
server to said second content server (col. 8, lines 44-67). 

20. As per claim 68 Ullman disclosed wherein a second content reference and a third content 
reference are both associated with said at least one hyperlink such that said means for switching 
over a connection fiirther comprises means for switching over a connection of said browser fi*om 
said second content reference to said third content reference of said at least one hyperlink after 
completion of said second content reference is completed (col. 8, lines 44-67), 



Claim Rejections - 35 USC § 103 
21 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



22. Claim 24,62 & 34 rejected under 35 U.S.C. 103(a) as being unpatentable over Ulbnan et 
al (U.S. 6,330,595) and in view of Malkin et al (U.S. 6,317,795). 

As per claim 24,62 Ullman failed to disclose wherein said step (b) comprises transmitting the 
video fi"om a current content server to a video browser of a user display via a media proxy 
controlled by a call processing server. In the same field of endeavor Malkin disclosed wherein 
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said step (b) comprises transmitting the video from a current content server to a video browser of 
a user display via a media proxy controlled by a call processing server (col. 7, lines 16-20). 

It would have been obvious to one having ordinary skill in the art at the time the invention was 
made to have incorporated transmitting the video from a current content server to a video 
browser of a user display via a media proxy controlled by a call processing server as taught by 
Malkin in the procedure of Ullman to reduce latency and make the transmission of the video 
more error free. 

23. As per claim 34 Ullman -Malkin disclosed a system for processing a time-dependent 
hyperlink in a video, comprising: a first content server comprising a video; a user input/output 
device comprising a display for displaying the video and an input output device for selecting a 
position on said display (Ulhnan, col. 4, lines 42-54); a browser arranged for connecting said 
user input/output device to said first content server (Ulhnan, col. 7, lines 45-51); at least one 
hyperlink and content reference cross-referenced with coordinates indicating where the at least 
one hyperlink appears in the video stored in said first content server (Ullman, col. 9, lines 16-24), 
said coordinates including display position and time during the video (Malkin, col 7, lines 39- 
44), and said content reference indicating a second content server comprising an electronic 
document to which the hyperlink is linked; means for determining when said hyperlink is 
selected by determining when coordinates at which the hyperlink appears in the video are 
selected; and means for switching over a connection of said browser from said first content 
server to said second content server for user access to said electronic document in said second 
content server when said means for determining determines that said hyperlink has been selected 
(Ulhnan, col. 10, lines 23-45 & col. 9, lines 9-24). 

Applicant's arguments are as follows: 

24. Applicant argued that prior art did not disclose that the switching over to the new session 
is only in response to the selection of coordinates video. 
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As per the argument Ullman disclosed the personal computer also receives the video program 
from the multi-channel cable and extracts the URLs, embedded in the vertical blanking interval 
of the video signal or directly transmitted over the internet. The client software extracts the 
URLs and retrieves the particular Web pages as described above. The Web pages are then 
synchronized with the particular video frames and presented to the user (col. 9, lines 9-16). For 
example, some one browsing the Intemet may come upon a major television network's Web site. 
They scroll to an interesting story then click on an hyperlink to turn on the software which tunes 
the TV window to the network to enhance the information residing at the Web site (col. 9, lines 
9-24). 

25. Applicant argued that prior art did not disclose that the user selects hyperlinks from the 
coordinates of the video. 

As per the argument Ullman disclosed the personal computer also receives the video program 
from the multi-channel cable and extracts the URLs, embedded in the vertical blanking interval 
of the video signal or directly transmitted over the intemet. The client software extracts the 
URLs and retrieves the particular Web pages as described above (col. 9, lines 9-14). 

26. Applicant argued that prior art did not disclose that the fiizz ball tracks or any other area 
of the video are hyperlinks which may be selected by a user to switch the browser connection. 

As per the argument Malkin disclosed that those skilled in the art will also appreciate that 
although the control specification has been described as a separate stream or track, that there are 
various alternative ways to provide an object level control specification. For example each frame 
of a video can include a rich PICS label, such as the F-lable (394), to specify the necessary 
control information associated with that frame (col. 13, lines 9-15). 

Applicant's arguments were not persuasive therefore the action is made Final. 
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Conclusion 



27. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

28. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Martin et al (U.S. 5,867,706) discloses the name convention of the resources over the network. 

29. Any inquiry concerning this conununication or earlier communication from the examiner 
should be directed to Adnan Mirza whose telephone number is (703)-305-4633. 

30. The examiner can normally be reached on Monday to Friday during normal business 
hours. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Rinehart can be reached on (703)-305-4815. The fax for this group is (703)- 
746-7239. 

3 1 . The fax phone numbers for the organization where this application or proceeding is 
assigned are as follows: 
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(703)-746-7239 (For Status Inquiries, Informal or Draft Communications, please label 
"PROPOSED" or "DRAFT"); 

(703)-746-7239 (For Official Communications Intended for entry, please mark "EXPEDITED 
PROCEDURE"), 

(703)-746-7238 (For After Final Communications). 

32. Any Inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703)-305-3900. 
Any response to a final action should be mailed to: 



Commissioner of Patents and Trademarks Washington, D.C. 20231 
Or faxed to: 

Hand-delivered responses should be brought to 4"^ Floor Receptionist, Crystal Park II, 
2021 Crystal Drive, Arlington, VA 22202. 



BOXAF 



Adnan Mirza 



Examiner 




